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We analyze the stability of the vortex lattice in a rotating superfluid against thermal 
fluctuations associated with the long-wavelength Tkachenko modes of the lattice. Inclusion 
of only the two-dimensional modes leads formally to instability in inflnite lattices; however, 
when the full three-dimensional spectrum of modes is taken into account, the thermally- 
induced lattice displacements are indeed flnite. 
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1 Introduction 

A rotating ^He superfluid accomodates angular momentum by forming an array of vortex 
lines, each having quantized circulation 27r/i/m, where m is the ^He mass. In a classic series of 
papers f^] , Tkachenko showed that the lowest energy conflguration of an inflnite vortex array 
is a two-dimensional triangular lattice, and that the lattice supports collective elastic modes; 
perpendicular to the rotation axis the modes travel with velocity (/if2/4m)^/^, where f2 is 
the rotational velocity of the fluid. Finite arrays, as Campbell and Ziff predicted 0, should 
exhibit distortions from triangular, structure seen experimentally by Packard and co-workers 
[0]. The question we address in this paper is whether the inflnite vortex lattice remains stable 
in the presence of thermal fluctuations associated with Tkachenko shear modes. 



As in a two-dimensional system, where long-wavelength modes forbid strict long-range 
translational order [Q, the long-wavelength Tkachenko motions of the lattice, when limited 
to the plane perpendicular to the rotation axis, lead to a weak logarithmic divergence of 
the displacements characteristic of a two-dimensional solid. However, when one includes 
the full three-dimensional spectrum of excitations of the vortex lattice, with line-bending 
contributions to the Tkachenko modes [5-8], stability of the lattice is restored. The vortex 
lattice provides an instructive realization of how addition of a third dimension leads to sta- 
bility of the ordering even if the order parameter varies in only two dimensions; the results 
are consistent with the usual Landau-Peierls stability arguments |^ in a three-dimensional 
system, which forbid an order parameter varying in only one dimension, but do not rule 
out stability for the two-dimensional variations encountered in the superfluid vortex lat- 
tice. Compared to a normal lattice, however, the vortex system has the peculiarity that 
the effective energy associated with lattice displacements depends on the displacements di- 
rectly, rather than simply on their derivatives; this dependence, arising, as seen below, from 
the intrinsic lack of Galilean invariance of a rotating system, acts to reduce the contribu- 
tion of long-wavelength excitations to the excursions of the vortices from their equilibrium 
sites. Understanding how stability is achieved in the vortex lattice is also instructive for the 
closely related issue of whether thermally-excited elastic shear modes drive instability of the 
Abrikosov magnetic-flux lattice in clean Type II superconductors and in the layered high T^ 
materials in particular |T(]]. Extension of the present analysis to flux lattices will be given 
in a subsequent paper [|1T|. 

To study the stability we apply the familiar methodology [^, ^, [T^ of calculating the 
contributions of the thermal fluctuations to the displacements of the vortices from their 
equilibrium sites by constructing the displacement autocorrelation functions in terms of the 
spectrum of modes [l^. In the following section we review the equations of motion of 
the vortex lattice; in Sec. 3 we derive the displacement autocorrelation functions of the 
lattice, and discuss the consequences for lattice stability and phase coherence. Appendix 
A derives the relation between the macroscopically averaged phase of the order parameter, 
flow velocity and vortex lattice displacements, and in Appendix B we analyze how the non- 
vanishing commutation relations obeyed by the components of the lattice displacements arise 
as one takes the limit in which the inertial mass of the vortex lines vanishes. 
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2 Equations of motion and long-wavelength modes 



We consider an incompressible, non-dissipative superfluid in a bucket rotating about the 
z-axis at angular velocity Q, and work in the frame rotating with the bucket; we follow the 
formulation given in Refs. and |^ of the complete non-linear dissipative hydrodynamics 
of a rotating superfluid, including the elasticity of the vortex lattice. The basic degrees 
of freedom are the macroscopic velocity field v{f,t) and the macroscopic field e{f,t) that 
describes long wavelength displacements of the vortices in the transverse {x, y) direction 
from their equilibrium locations. (In general, the local vortex line velocity in the transverse 
direction, e, does not equal v±, the superfluid velocity in the plane.) Prior to calculating 
the thermal fluctuations of the lattice we summarize the equations of motion obeyed by v 
and e, and the long wavelength modes of the vortex lattice. 

In order to bring out the character of the equations for the modes, we assume, as in Ref. 
[0], that the vortex lines have an effective mass per unit length, and thus carry a normal 
fluid density p*, which we assume to be <C p, the mass density of the fluid in the end 
we take p* 0. The mass current, j, is given by 

J = pv + p*{e- v^); (1) 

for incompressible flow, 

V-/=0. (2) 

The dynamics of the system are specified by the superfluid acceleration equation and the 
law of conservation of momentum. The linearized superfluid acceleration equation in the 
rotating frame is 

dv -> • 

_ + 2fi xe = -V/x', (3) 

where p' = p — {Q x f)'^ /2 and p the chemical potential per unit mass. 

This equation is the time derivative of the relation between the macroscopically averaged 
phase of the condensate wave function and the macroscopically averaged flow velocity and 
vortex displacements; as we show in Appendix A, for small displacements of the vortex 
lattice, 

V +2n X e = —V(f). (4) 
m 
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Equation (Q) generalizes the usual relation, v = h/mV(f), to the rotating system, where the 
flow velocity can have non-zero vorticity as a consequence of local variations of the vortex 
density. Equation (H) is the analog in the rotating system of the relation between the flow 
velocity and phase in a superconductor in the presence of a vector potential, 

V + — A = — V0. (5) 

mc m 

Comparing with Eq. (|]), we see that /i' is related to the phase in the usual way, 

^{r,t) = — . 6) 

m at 

The linearized equation for conservation of momentum in the rotating frame is 

^ + 2Q xj + VP' = -a,i-(, (7) 

where P' = P — p{Q x r )^/2 and P is the pressure; —aei is the elastic force density (directed 
in the transverse plane) arising from deformations of the vortex lattice, given in terms of the 
elastic energy density, E^i, of the vortex lattice by 

^ei = ^ = ^[2Vx(V ■ e) - Vie] - 2fiA — . (8) 

Here 2f2A = UyE^ is the vortex line energy measured per unit volume, where is the 
energy per unit length of a vortex line, and = mQ/irh is the number of lines per unit 
area. (The detailed elastic constant multiplying V^e in the right side of (||) is specific to a 
triangular lattice.) We include in (|^) an external driving force —( (r, t) acting on the lattice, 
derived from an external perturbation H' = ( ■ e, to facilitate calculation of the displacement 
autocorrelation functions. 

At low temperatures one may neglect the normal fluid mass density associated with the 
bulk excitations (phonons and rotons) of the fluid. Then in Eq. (|^), VP' = pV /x', which 
we eliminate using (|^); keeping p* only in the inertial term we find 

P*§-^i^- ^± ) - 2p^i X {k- v^) = -a,i - C (9) 

To compute the superfiuid velocity in terms of e, we assume a plane-wave spatial dependence 
with wave vector k, and from (0) and (^ find, for p* ^ p, that 

^7 + 2n X e = k[k ■ {2n x e)], (10) 
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where k is the unit vector in the k direction. This equation imphes that a displacement of 
the vortex lattice, even uniform, induces a flow velocity, a consequence of the lack of Galilean 
invariance in a rotating system. The quantity on the right side of (0) is the variation of the 
macroscopically averaged phase of the order parameter. 

The equations of motion are most simply written in terms of the longitudinal and trans- 
verse displacements defined hj ei = q ■ e and ex = z ■ {q x e), where q is the unit vector in 
the X, y plane along the direction of the projection of k in the plane. (The limit of k along 
the rotation axis presents no ambiguities.) Substituting v from Eq. (|ToD into @ and taking 
longitudinal and transverse components, we derive the coupled equations of motion for ei 
and Ct- 

p*eL + 2pQeT + aiei = -q ■ C = -(l, 

p*eT - 2pQeL + otCt = -z ■ {q x () = -(t, (H) 



where 



adk) = m'p -ki + 2nXk 

4m 

arik) = 4n'pkl + ^kl + 2QXkl (12) 

4m 

Equations (|lT]) agree in content with those given in Ref. |^. Note that they imply that the 
energy 

Ev = Y: l[p*iel + 4) + «Lei + are'r] (13) 
it 

is conserved, in the absence of external perturbations. The fact that the energy depends 
directly on the displacements, not only on their derivatives, as is the situation in a normal 
lattice, is a consequence of a vortex displacement inducing a flow velocity, Eq. ([T0|). 

The frequencies u of the normal modes of the system, determined by the four roots of 
the secular equation 

D{k, uj) = (p*cj2 - aL){p*uj^ - ar) - AVl^p'^uj^ = 0, (14) 

correspond to a high frequency inertial mode, of frequency given for small k by 

u;j = i2np/p*)\ (15) 
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and a generalized Tkachenko mode of frequency given for small k by 



T 



(2f2 cos I 



+ 



cos^ Q{\ + cos^ 6*) + — sm^ 6* 

p 4m 



(16) 



where Q is the angle between the wavevector k and the rotation axis. At Q = 7r/2, Eq. (|TB|) 
reduces to u)^ = (^fi/4m)fc^, Tkachenko's original result. 



3 Displacement correlation functions and lattice sta- 
bility 

To calculate the effect of thermal excitation of Tkachenko modes on the displacements of 
the lattice, we first construct the space-time Fourier transform of the retarded-commutator 
correlation function from the relation 

(e.e,) = h^-^. (17) 



Solution of Eqs. (0) for e in terms of (, 

cl \ _ 1 / P*i^^ — ctT —2iVtpuj \ f Cl 



-^tJ D{k,uj)\ '^inpuj p*u^-aLj\CT 
yields the correlation functions 



:i8) 



{eLeL){k,uj) 
{eTeT){k,Lj) 



h{p*uj'^ - ax) 

D{k,uj) 
h{p*uj'^ - ai) 

D{k,Lu) ' 



{e^erKkuj) = (eTe.)(^, c.)* = (19) 

D{k, uj) 

The correlation functions (^) are conveniently written in terms of their spectral weights, 
defined by 

V /r N duj' Cii(k,u') , , 
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The weight functions obey the symmetries CiLik, —u) = —CLL{k,u!), and CTT^k, —u) = 
—CTT{k,u!), while CLxik, —u) = CTiik^uj)] as we find from (0), the weights are given, for 
a; > 0, by 

CLL{k,uj) = ——d{uj-uJi)^ d{uJ-UJT), 

CTT[k,uj) = ——d{uj~uJi)^ d{uj-ujT), 

Z\lp ax 

CMk,co) = ^[Sico~uJi)-Sico-ujT)]. (21) 

The equal-time spatial correlations of the displacements of the vortex lines in the rotating 
fluid at temperature T = 1/ (3 are given by 

(6,(r,t)e,(r-",t)) = j ^^e^^^-%,,(^, + /M), (22) 

where i, j denotes the transverse or longitudinal components, R = f—f', and f{uj) = {^e^^^ — 
1)~^. Because is non-zero for — > 0, the longitudinal correlation function (eL(r )ej;,(r ')) 
has a finite range of order several vortex spacings; however, since ut vanishes for in-plane 
wavevectors approaching zero, the transverse correlation function {eT{r)eT{r')) falls as 1/R± 
in the x,y plane. Since for general k, (e^) = (ef. + ef), we see that in the limit p* — >• 0, at 
equal times, 

am -e{r '))') = J + (1 + 2/(^t)). 

(23) 

Were we to take into account only two-dimensional displacements of the vortex lattice, 
i.e., restrict k to the transverse plane, we would find, rather, 

mr) - nnf) = / - cosk ■ R)t^r + ^) d + m^T)), 

(24) 

where Z is the container thickness in the z direction {Zp is the mass per unit area). Equa- 
tion (p^ implies that Tkachenko modes in the transverse plane should, formally, prevent 
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formation of a stable two-dimensional lattice. The infrared contribution to the integral in 
the limit of large separation R = \r — r'\ is 

er)-er ~— /— — / — , 25 

Zp Jo [iTiY k 

which diverges as Ini?. The instability in two dimensions is driven by the softness of the 
energy associated with shearing, ~ a^, for k lying in the x,y plane (see Eq. (0)), leading 
to a In i? divergence in the transverse correlation function. As in three dimensions, the longi- 
tudinal displacement correlation function has finite range. The mean square displacement of 
a vortex from its equilibrium site similarly diverges as In TZ, where TZ is the container radius. 

But one should note that such an instability could, in fact, manifest itself only in films 
no more than tens of atomic layers thick. The square of the displacement as a fraction of 
the area per vortex becomes, to within a constant in the logarithm, 

{eT{rf)n, ^ 3-^-i-lniV„, (26) 

where ko is the Debye wavevector, defined by p/m = k^/Gn'^; Qd = fi'^k'j^/2m, and A^^, is 
the total number of vortex lines in the system. For (T/B^)) InN^ of order unity, the mean 
displacements can become comparable to the intervortex spacing only for /c^Z<10^. 

When the full three-dimensional degrees of freedom of the vortex excitations are taken 
into account, we find, instead, a finite infrared contribution. 



(27) 



(27r)3 Vot o^lJ Jo (27r)3 puj^ 
Pdk- 



T /■! dcose /• ,2 „ l + cos^e 



p J -I A-n^ Jo 4fi2 cos2 e + (hk^n/Am) sin^ 9 



The two terms in (1 + cos^ 6) arise respectively from transverse and longitudinal displace- 
ments. Inclusion of the full three-dimensional spectrum of long- wavelength fluctuations thus 
stabilizes the vortex lattice. The excursions of the vortices from their equilibrium positions 
are made finite by the smaller phase space for excitations of small k in three dimensions, 
and the non- vanishing of both the transverse and longitudinal coefficients, ai and a^, in 
the energy (p!3D, as — > with cos6' > 0. Detailed evaluation of (e (r )^) requires calculation 
over all k, not just the long- wavelength modes. 
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What are the imphcations of the thermal fluctuations of the lattice vibrations for the 
macroscopically averaged phase 0(r, t) of the condensate wave function? Since the system 
preserves a global (gauge) invariance allowing changes of the phase by an additive constant, 
only relative phases have physical meaning. The invariant correlations of the order parameter 
are given at equal time, for Gaussianly-distributed Fourier components of the phase, by 

(^^im^-iHr')'^ = e'^^'-'^^'^-^^^'^^^K (28) 

For plane-wave spatial dependence Eq. ( |Tol) implies that 

irn ^ 2imVL 

(P= 2n-(kxe] = ——sm9eT; 29 
hk nk 

transverse fluctuations of the lattice positions give rise to phase fluctuations of longer range 
(owing to the extra power of k in the denominator). Calculating the correlation of phase 
differences from Eqs. (^) and ([T9|) we have, 

(((/.(r) - 0(f '))') = y (^^(1-^osfc-i?) f \ CTT{Kuj){l + f{u)) 

d^k il — cosk-R\ (2mQ, sin O)"^ , 

' ' ^ ^ ■c^t(1 + 2/(cut)) 



(277)3 I p I 

\n{jxR^n^). (30) 



ko <S>D 

Formally, (|30D diverges logarithmically as i? oo, leading to the correlation function 
^g«0{r)g-»(/)(r')^ falling to zero as a power of R, as discussed originally by Moore [|l^]. Nu- 
merically, this falloff is insigniflcant in any flnite system, since the vortex lattice spacing 
oc is always huge compared with the interparticle spacing oc A;^^, while ln(77 i?^n^) is 

less than InA^^,, where is the total number of vortices in the system. 

In general though, vanishing of the correlation function (e^'^'^^e"*'^*^'''-') for large R does 
not indicate a loss of superfluidity. As Josephson stressed, by analogy to a very floppy 
"slinky," such correlations do not tell one the fluctuations in the winding of the phase angle 
around a closed loop. Note also that correlations of the gradients of the phase remain flnite 
as -R — > cxD. 

The existence of transverse excitations of the velocity fleld causes the normal mass density, 
as measured by the moment of inertia, to equal to the full mass density. The normal mass 
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density, is related to the transverse current autocorrelation function by (see, e.g., [0). 

Pn = - lim {jTjT){k ,uj = 0). (31) 

^ — * 

Taking p* = 0, whereupon j = pv, and calculating the transverse component of the velocity 
from Eq. (|10D, we find vt = -{2^1 x e)T = -2fieL, and from Eqs. (^) and (^ that 

Pn = - lim {vtVt) {k,LJ = 0) = - lim {2VLpf {eLeL){k , = 0) = p. (32) 



Tkachenko excitations replenish the "sum rule" (|31|) , reflecting the fact that in the limit of a 
dense vortex lattice the moment of inertia of the container of superfluid takes on its normal 
fluid value. However, this result does not imply that the superfluid density measured dy- 
namically, e.g., in a second sound experiment, vanishes; rather, in the non-Galilean invariant 
rotating system, the two measures become independent. 

I am grateful to A. J. Leggett and C. J. Pethick for extensive discussions, and to E. 
Fradkin and R. E. Peierls for critical comments. This research was supported in part by 
National Science Foundation Grant DMR91-22385. 



Appendix A. Macroscopically- averaged phase of the or- 
der parameter 

In this Appendix we derive the relation (^) between the macroscopic averages of the phase 
of the order parameter, the flow velocity and the vortex displacements. Imagine displacing a 
single vortex line, initally along the 2;-axis, by a small amount e{z) in the transverse plane. 
[We denote the local velocity, displacement and potential by V , e, and $, to distinguish 
them from the long-wavelength averaged quantities, v, e, and 0.] The flow velocity, V, of 
the fluid about the vortex line obeys 

V X V(r) = — [ dfS(r~r(l)), (33) 
m J 

where / is the distance along the line. For small e, dl/dz = [de [z) / dz, 1) (the final component 
being in the z-direction); thus 

V X V{r) = - l] 6{x - eMy ' ^y). (34) 
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Taking the curl of (p4D, expanding the right side to first order in e, and assuming an incom- 
pressible fluid, V ■ V = 0, we find that the first variation of the velocity obeys 

Uv - ^ex z6{x)6{y)\ = Ay (L^ - Sy-^) S{x)6{y)\ , (35) 



with solution 



where 



SV{f) = —ex z6{x)6{y) + — W$, (36) 
m m 



V'6<l> = 27r (^e,-^ - Sy^^ S{x)6{y). (37) 

Since at points away from the line, the velocity is given by h/m times the gradient of the 
phase of the order parameter, we identify 5$ as the first variation of the phase of the order 
parameter due to displacement of the hne. 

We now sum (^) over a lattice of vortices, and carry out a long wavelength average. Since 
the average of at = is the uniform rotational velocity, Q xf, the long wavelength aver- 
age of 6V is the flow velocity, v, in the rotating frame; similarly the long-wavelength average 
of (5$ is the macroscopically-averaged phase, 0, in the rotating frame. Using hriv/m = 2Q 
we derive Eq. (^), 

h 

V +2VL xe= — V0. 

m 

Equation (^^ is readily integrated in terms of the Bessel function Kq; for a given wavevec- 
tor q in the 2;-direction, 

h Id 
5$(f ) = — {syX - e^y) —j—Ko{qr^), (38) 
m r_L or± 

where r± = (x^ -|- y'^Y^'^. At short distances from the line, qr± <C 1, 5$(r*) is given by 
{h/m)6ta.n~^ {{y — ey{z))/{x — ex{z))), i.e., the variation of the potential for a straight vor- 
tex line evaluated at the locally displaced position of the line. On the other hand, far from 

1 /2 

the line, gr_L 3> 1, the variation $(f^ vanishes exponentially as exp(— gr_L)/r_L . 
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Appendix B. Commutation relations of the vortex dis- 
placements 

The coefficients of in the high frequency hmits of the correlation functions ([19D imply, 
as expected, that at equal time, all components of the displacements commute ([e^, ej]){k ) = 
0, while the displacements and their time rates of change obey the equal-time commutation 
relations 

{[e,,e,]m = {[eT,eT]m = ^, (39) 

and 

([6^,6T])(fc)=0. (40) 

On the other hand, if we assume ab initio that the inertial mass density p* associated with 
the vortex lines vanishes, then the commutation relations take on a quite different structure. 
The correlation functions are given by 



—t 

{eTeT){k,uj) 



D'{k,u)' 
D'{k,ujy 



= -1^, (41) 

D'{k, uj) 

where D'{k,Lj) = aiax — ^^^ p^oj"^ ■ At equal time, {[eL,tL\){k) = = ([e-r, er])(^ ), as before; 
now, however, the longitudinal and transverse displacements no longer commute, but rather 
obey 

(fe..d)(«) = |^. (42) 
The corresponding spectral weights are, for > 0, 

CLL{k, to) = '^^^'^ 5{uj - Ut), Cxrik, uj) = '^^^'^ S{uj - ujt), (43) 
paL par 



and 



-t Trfi 

CLxik, uj) = -77T^S{u - ujt). (44) 
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How does the non-vanishing commutation relation (^) develop? By letting p* go to 0, 
or never introducing it in the first place, one is using an effective low frequency theory valid 
on frequency scales -C oJi- Indeed, the exact vanishing of ([eL,eT])(fc) comes about through 
a cancellation of the weight of the two delta functions in Clt in (PiP- In the effective theory, 
the delta functions at oJi are absent in the spectral weight functions (^3|) and (0), and the 
cancellation in Clt no longer takes place, leaving the effective commutation relation (42). 



The operators of the low frequency theory are essentially time-averaged over several periods 
2'k/oji. 

In the limit p* — > 0, the effective Hamiltonian of the system becomes [cf. Eq. (|13|) ], 

^ = E + oiTel) + ClCl + Crer) , (45) 



and the equations of motion (|TT]) (at p* = 0) follow directly from (^) using the commutation 
relation (^). The system is structurally that of an ensemble of harmonic oscillators, but 
unlike in a normal lattice, the energy depends on the displacements directly, rather than 
only on their derivatives. Note that the first integral in the contribution (|27| ) of the long- 
wavelength modes to the displacements follows directly from (|45|) . 

It is instructive to compare this situation with the analogous one of two-dimensional 
motion of a particle in a magnetic field, Ti, in the guiding center approximation Consider 



Ti in the z direction and motion only in the transverse plane. In the gauge in which the 
Hamiltonian is H = [pi + {py — eHx/cy]/2m, the operator equations of motion have as 
integrals, 



(46) 




y{t) = y(0)- (x(0)-^)sina;it + ^(coscuLt-l) 



where uol = eTi/mc. These solutions preserve, as they must, the commutation relation 
[x(t),y(t)] = 0. 

In studying motions varying slowly on the scale of a Larmor period, it is useful to av- 
erage over several Larmor periods, the equivalent of averaging over several periods of the 
high-frequency inertial mode in the vortex problem. From Eqs. (EB) we find the averaged 
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coordinate operators, 



,(t) = m, j(«)=,(0)-^. (47) 

mujL muji 

These averaged operators do not, in fact, commute, but rather obey 

[x{t),y{t)] = -^, (48) 
mujL 

the analog of the commutator (|4^) of the displacement operators in the low-frequency effec- 



tive theory 19 



In the presence of a driving potential V{x, y), the equation of motion is mf = {e/c){f x 
Ti) — W. For slowly varying phenomena, one can similarly neglect the inertia term here 
and replace the operators by their averages over several Larmor periods, in which case the 
equation of motion reduces, in the limit m — 0, to the requirement that the net force on 
the particle vanish: 

-{P xn)-VV{x{t),y{t)) = 0, (49) 
c 

the analog of Eqs. ( p!TD in the limit p* 0. This equation can be derived directly from the 
effective Hamiltonian, H = V{x{t),y{t)), using the commutation relation 
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